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ABSTRACT 

Objective: To compare doctors' and nurses' 
communication with patients in primary care telephone 
triage consultations. 

Design: Qualitative comparative study of content and 
form of questions in 51 telephone triage encounters 
between practitioners (general practitioners (GPs)=29; 
nurses=22) and patients requesting a same-day 
appointment in primary care. Audio-recordings of 
nurse-led calls were synchronised with video 
recordings of nurse's use of computer decision 
support software (CDSS) during triage. 
Setting: 2 GP practices in Devon and Warwickshire, 
UK. 

Participants: 4 GPs and 29 patients; and 4 nurses 
and 22 patients requesting a same-day face-to-face 
appointment with a GP. 

Main outcome measure: Form and content of 
practitioner-initiated questions and patient responses 
during clinical assessment. 

Results: A total of 484 question-response sequences 
were coded (160 GP; 324 N). Despite average call 
lengths being similar (GP=4 min, 37 s, (SD=1 min, 
26 s); N=4 min, 39 s, (SD=2 min, 22 s)), GPs and 
nurses differed in the average number (GP=5.51, 
(SD=4.66); N=14.72, (SD=6.42)), content and form of 
questions asked. A higher frequency of questioning in 
nurse-led triage was found to be due to nurses' use of 
CDSS to guide telephone triage. 89% of nurse 
questions were oriented to asking patients about their 
reported symptoms or to wider-information gathering, 
compared to 54% of GP questions. 43% of GP 
questions involved eliciting patient concerns or 
expectations, and obtaining details of medical history, 
compared to 11% of nurse questions. Nurses using 
CDSS frequently delivered questions designed as 
declarative statements requesting confirmation and 
which typically preferred a 'no problem' response. 
In contrast, GPs asked a higher proportion of 
interrogative questions designed to request 
information. 

Conclusions: Nurses and GPs emphasise different 
aspects of the clinical assessment process during 
telephone triage. These different styles of triage have 
implications for the type of information available 



Strengths and limitations of this study 



The first study to provide naturally occurring 
audio and video data directly comparing nurse- 
led and general practitioner (GP)-led triage. It 
provides clear evidence that computer decision 
support software (CDSS) organises nurse ques- 
tioning, creating very different triage interactions 
to GPs not using CDSS. 
This study was limited by the inclusion of only 
two GP practices. Given further training in the 
use of CDSS, the nurses in this study might also 
have conducted triage differently. 
The different styles of triage we observed have 
implications for the type of information collected 
from patients, and for how patients experience 
triage. 



following nurse-led or doctor-led triage, and for how 
patients experience triage. 



INTRODUCTION 

Telephone triage is the process where calls 
from people with a healthcare problem are 
received, assessed and managed by giving 
advice or by referral to a more appropriate 
service. 1 It is increasingly being used inter- 
nationally to help with the provision of 
out-of-hours care, manage demand for care 
or provide an additional source of help and 
advice. 2 In the UK, the use of the telephone 
to triage patients requesting same-day 
appointments represents one strategy to 
manage the increasing workload taking place 
in primary care. 3 Nurses and general practi- 
tioners (GPs) may provide telephone triage 
and consultation, with nurses typically trained 
to use computerised decision support soft- 
ware to provide this service, both in office 
hours and out of hours. While there is some 
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evidence that telephone triage may reduce GP work- 
load, 4 5 there is equivocal evidence that telephone triage 
is a safe 6-9 and satisfactory means of delivering care to 
patients. 5 10 The quality of patient-clinician interaction 
during triage and telephone consultation is key to aspects 
of safety, effectiveness, patient experience 2 11 and, poten- 
tially, to health outcomes. 12 How clinicians communicate 
with patients and respond to their presenting concerns 
within telephone triage consultations is therefore central 
to decisions about its delivery within primary care. 

Research comparing how GPs and nurses communi- 
cate with patients within face-to-face consultations has 
identified patterned differences in the process of asses- 
sing patients and in the opportunities afforded to 
patients to explain their presenting problems. 13 
Richards et al 14 used GPs and nurses to retrospectively 
assess audio-taped nurse-led telephone triage, and 
found that GPs and nurses had only moderate levels of 
agreement on the level of information sought by nurses 
and on the appropriateness of triage outcome. A recent 
study using conversation analytic methods to compare 
doctor-patient consultations conducted face-to-face and 
on the telephone 15 found little difference in consult- 
ation styles between the two methods of delivering care, 
but found that patients differed in the number and com- 
plexity of topics introduced on the telephone compared 
with face-to-face consultations. 

The role of computer decision support software 
(CDSS) and the professionals who use it is central to 
assessing the safety and effectiveness of telephone triage. 
In primary care, CDSS is promoted as supporting the 
clinical expertise of nurses to conduct triage, 16 repre- 
senting a substitute for the expertise provided by GPs 
who do not use CDSS to triage patients. While there is 
evidence that using CDSS to support clinical decisions is 
a safe and effective means of triaging patients, 17 other 
research suggests that nurses orientate to potential dis- 
sonance between CDSS question prompts and the spe- 
cific circumstances of the caller's concern 18 ; interact 
with the patient and the CDSS in 'purposive interaction 
chains' 19 ; or regularly deviate from and modify CDSS 
prompted questions, potentially leading to a divergence 
rather than standardisation in triage outcomes. 20 

A recent retrospective case review of closed malprac- 
tice claims regarding telephone-related consultations in 
the USA 21 found that 38% of litigation cases were 
because of problems with communication. Reporting on 
cases involving clinicians from a range of professional 
disciplines, Katz et al suggested that as workload 
increases, clinicians may rush through triage and in 
some cases patients may be doing the triage rather than 
the clinician. 

In a similar analysis of calls to Swedish Healthcare 
Direct, Ernesater et af 2 reported that failures in commu- 
nication and asking the caller too few questions were 
commonly observed in malpractice claims, a finding also 
reported in a Dutch study of simulated calls to 
out-of-hours centres. 17 



If nurse/ GP triage is to be widely used within primary 
care in the UK, there is therefore a need for greater 
insight into patient-clinician telephone communication 
that is both safe and acceptable to patients. Until now, 
there has been no research that has directly compared 
telephone triage communication of nurses using CDSS 
with GPs conducting telephone triage without the add- 
itional support of CDSS. 

We compared communication between GP-led and 
nurse-led computer-supported telephone triage in 
primary care. We proposed to contribute to an under- 
standing of the 'real-time' use of telephone triage in 
primary care by nurses and GPs. In this article, we focus 
on a key element of telephone triage — the interrogative 
series driving the process of clinical assessment — a 
crucial source of information to support decision- 
making about triage outcomes. 



PARTICIPANTS AND METHODS 

The research was a substudy that formed part of the 
recruitment process for the ESTEEM trial, 23 the first mul- 
ticentre randomised controlled trial to compare GP-led 
versus nurse-led telephone triage versus usual care for 
UK patients requesting same-day appointments. A quali- 
tative comparative study of nurse-led and GP-led triage 
consultations was used to enable close analysis of inter- 
action between clinicians and patients; and the role the 
CDSS played in organising nurse-patient interactions. 

Five intervention practices were approached (2 nurses 
and 3 GPs), of which two were recruited successfully 
(1 nurse and 1 GP). Four nurses and four GPs partici- 
pated. Participating practices were not systematically 
triaging patients prior to their inclusion in ESTEEM, 
and therefore nurses had to be trained in the use of 
CDSS prior to starting the trial. However, data for the 
substudy were not collected until practices were in their 
final week (average 8 weeks post-training in CDSS) of 
participation in ESTEEM. Patients (or their proxy) who 
phoned their surgery requesting a same-day, face-to-face 
appointment with a GP were eligible for participation. 
Patients were excluded from the substudy if they did not 
fulfil the criteria for inclusion to the main ESTEEM 
trial, 23 including: 

► Patients who were (1) too ill to participate; (2) unable 
to speak English; (3) temporary residents. 

► Young people aged 12-15.9 years. 

► Children under 12 years unless a proxy phoned on 
their behalf. 

Over a 2-day period in each practice, 81 audio- 
recordings of telephone triage (47 nurse and 34 GP) and 
35 video-recordings of nurses' use of Odyssey CDSS were 
made. Written consent was given by patients to analyse 51 
complete recorded calls (22 nurse and 29 GP) including 
10 video-recordings. Video-recordings were synchronised 
with audio-recordings to enable analysis of how nurses 
used Odyssey during triage. Demographic data collected 
as part of the ESTEEM trial were also extracted for 
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Table 1 Call sample 


Call sample descriptors 


Nurse-led 


GP-led 


Male 


5 


6 


Female 


■4 -7 
1 / 


23 


Mean patient age (years) 


/ICO 


A A "7 
44. / 


Patient age range (years) 


■i A QQ A 

\ A— oo.4 


n o on a 
\j.tL— oU.b 


Calling on own behalf 


17 


22 


Calling on behalf of other 


5 




Unknown problem 


18 


• 


Known problem 


5 




Single-issue problem 


22 


23 


Multiple problems 


0 


6 





I 



Table 3 Transcription conventions 24 



consented patients. Call length was determined by the 
length of the recording, which began as soon as the 
patient picked up the telephone and ended at the call 
close. Forty women (17 nurse, 23 GP) and 11 men partici- 
pated, with an average age of 44 years (SD=25; see 
table 1 ) . In addition, triage outcome was collected for all 
consenting patients (see table 2). 

Analysis 

All calls were transcribed in detail according to standard 
conversation analytic conventions 24 (see table 3 for tran- 
scription key). Call lengths were measured from audio- 
recordings. This led to identifying potentially important 
differences between the two groups in call length and 
numbers of questions clinicians asked. In order to 
understand the nature of these differences, we adapted 
an established conversation-analytic coding scheme for 
analysis of question-response sequences. 25 Conversation 
analysis is increasingly being used to support medical 
research aimed at understanding the distribution of 
interactional practices by offering operational definitions 
of phenomena that can subsequently be coded and 
counted. 26 Inclusion criteria for the coding scheme were 
as follows: 

► Questions had to effectively seek to elicit information, 
confirmation or agreement whether or not they 
made use of an interrogative sentence type; 

► Questions seeking acknowledgement were not coded 
because they sought neither confirmation nor 
affirmation; 

► Repair questions ('Pardon') as well as partial repeats 
('He went where?') were not coded; 



Table 2 Triage outcome 


Triage outcome 


Nurse-led 


GP-led 


Same day with nurse 


10 


2 


Same day with GP 


6 


18 


Nurse or GP next day 


3 




Nurse or GP 3-7 days 


1 


i 


Self-care 


2 




Nurse or GP >7 days 


0 


5 





(■: 



>he said< 



Underlining 



U 



she wa:: 
nted 



[] 



tl know it,° 



- 



A micropause, hearable but too short to 
measure 

'Greater than' and lesser than' signs 
enclose speeded-up talk. Occasionally they 
are used the other way round for slower talk 
Indicates emphasis; the extent of 
underlining within individual words locates 
emphasis and also indicates how heavy it is 
Vertical arrows precede marked pitch 
movement, over and above normal rhythms 
of speech. They are used for notable 
changes in pitch beyond those represented 
by stops, commas and question marks 
Colons show degrees of elongation of the 
prior sound; the more the colons, the more 
the elongation 

Square brackets mark the start and end of 
overlapping speech. They are aligned to 
mark the precise position of overlap as in 
the example below 

'Degree' signs enclose hearably quieter 
speech 



► Questions that suggest, propose or offer something to 
another as well as questions that request something 
from another were not coded (eg, "Can I just confirm 
your date of birth before we go any further" or 
"Just bear with me a moment, we'll have a look for 
you"). 

The scheme included 12 coding categories (see box 1), 
including question design, the action they performed 
and the responses elicited. We also coded for an add- 
itional dimension of the broader activity questions were 
oriented towards. Working from the inclusion criteria 
with audio-recordings and transcripts, all eligible ques- 
tions were identified and agreed on by JM, RB and JP 
(n=484). Each of the two raters (JM, RB) then independ- 
ently coded 10% of questions to determine the inter-rater 
reliability, k Scores were calculated for all coding 



Box 1 Question-response coding scheme (adapted from 
Stivers and Enfield 2010) 



► Semantic structure 

► Through-produced multiquestions 

► Polar questions— turn-final element; 
declarative 

► Type of Q-word in content Wh-questions 

► Social action of question 

► Response type 

► Response timing 

► Confirming or disconfirming answer to polar question 

► Form of answer to polar question 
Added for analysis of triage interactions: 

► Question activity— reported symptom; wider-information gath- 
ering; eliciting patient explanations, views; medical history 



negative marking; 
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categories revealing moderate-to-high levels of agreement 
(0.67-1.00). JM coded the remaining data and ambigu- 
ous cases were discussed in order to reach a consensus on 
the final code. JM, RB and JP then closely examined 
prototypical cases identified in the coding of question- 
response sequences and which demonstrated recurrent 
patterns of interaction across the consultations. 



RESULTS 
Question activity 

Average call length (minutes:seconds — mean, SD, range) 
was similar across both arms, (nurse-led=4:39, 2:22, 1:45- 
10:46; GP-led=4:37, 1:26, 1:29-8:14). However, nurses 
asked patients an average of 14.7 (SD=6.4, range=4-28) 
questions to assess the problem during telephone triage 
consultations, in contrast to only 5.5 (SD=4.6, range=0- 
17) asked by GPs. Nurses were predominantly oriented 
towards two types of question activity (table 4) — the 
assessment of the patient's reported symptom (nurse 
32.1%; GP 21.9%) and wider information gathering 
around the reported symptom (nurse 56.8%; GP 32.5%). 
In contrast, GP questions were more evenly distributed 
across four types of question activity, including eliciting 
the patient's own explanations for their symptoms (nurse 
2.5%; GP 13.1%) — for example, There's no obvious explan- 
ation for that? and seeking a more detailed medical 



history from the patient (nurse 8.6%; GP 30%) — for 
example, What do you attend the hospital for? 

Question design and action 

Over three-quarters of questions deployed by GPs and 
nurses (nurse 82.1%; GP 76.3%) were polar questions. 
A key feature of polar questions is that they are designed 
for either a yes or no response. 27 Second, polar ques- 
tions are commonly employed in medical history-taking 
where they are frequently designed to prefer a 'no 
problem' response. For example, the inclusion of the 
negative polarity item 'at all' tilts, Has she a temperature at 
all? to prefer a no and therefore the absence of fever 
(an optimal state of affairs). In contrast, And you re breath- 
ing normally? prefers a yes response and therefore the 
absence of breathing problems (again an optimal state 
of affairs). GPs used a higher proportion of polar ques- 
tions with an interrogative design (nurse 29.94%; GP 
46.25%) — for example, Have you vomited at all? while 
over half of the nurses' polar questions were designed as 
declarative statements (nurse 52.16%; GP 30%) with a 
presupposed answer embodied within the question for 
confirmation or disconfirmation — for example, passing 
urine okay? The proportion of polar, declarative ques- 
tions used by nurses is also reflected in the proportion 
of questions that nurses asked that requested caller con- 
firmation (nurse 53.7%; GP 31.87%). This stood out in 



Table 4 Interrogative series: coding for question activity, design and action 




Nurse (%) 


GP (%) 


Activity 






Reported symptom 


32.1 


21.9 


eg, Is he getting more breathless? 






Wider information gathering 


56.8 


32.5 


eg, and have you got a temperature at all do you feel hot? 






Eliciting patient's concerns/ideas/expectations 


2.5 


13.1 


eg, There's no obvious explanation for that? 






Medical history 


8.6 


30.0 


eg, And is there any family history of arthritis of any sort? 






Design 






Polar questions — interrogative 


29.9 (25.9) 


46.3 (26.3) 


eg, Has she vomited at all 






(Reported symptom and wider-info gathering activities only) 






Polar questions — declarative 


52.2 (45.4) 


30.0 (12.5) 


eg, And she's weeing okay 






(Reported symptom and wider-info gathering activities only) 






Content WH — questions 


13.3 


18.8 


eg, And when did the tiredness first start 






Alternative questions 


4.6 


5.0 


eg, Is it quite bad or just a little bit of dizziness 






Action 






Request for confirmation 


53.7 (46.6) 


31.9 (13.8) 


eg, And you said no discharge and no pain 






(Reported symptom and wider-info gathering activities only) 






Request for information 


46.0 (42.3) 


68.1 (40.6) 


eg, Do you wear glasses or contact lenses? 






(Reported symptom and wider-info gathering activities only) 
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contrast to GPs predominantly asking questions that 
requested information rather than confirmation (nurse 
45.99%; GP 68.13%). 

Nurses using CDSS were therefore deploying a higher 
proportion of declarative questions about the patient's 
reported symptom or wider information gathering than 
GPs, designed to optimise the report of the patient's 
situation by ruling out a variety of medical problems 
(nurse 45.37%; GP 12.51%). In contrast, GPs, not using 
CDSS and therefore more able to self-determine their 
questions, employed questions more evenly distributed 
across the four different activities, typically designed as 
interrogatives aimed at requesting information from the 
caller. In order to reveal the implications of these differ- 
ent distributions for how GPs and nurses, using CDSS, 
conducted telephone triage in our sample, it is neces- 
sary to examine how these differences in question 
number, activity, design and action are consequential 
within the triage interactions themselves. 

Gathering information during nurse-led triage: 
a 'no problem' question series 

When patients present a problem to clinicians, they may 
report several symptoms. Nurses, using Odyssey CDSS, 
need to select one of these symptoms and enter a key 
word to activate the CDSS for conducting triage with the 
patient. This activates a pop-up box with a series of 
symptom-related questions that prompt the nurse to ask 
of the patient. The nurse can select which questions to 
ask first, but it is important that the nurse asks those 
with a red or orange flag positioned adjacent to the 
question. Red-flagged questions have a default setting at 
the highest level of urgency and therefore, if left 
unanswered, Odyssey will recommend an emergency 
response. For each question asked, Odyssey prompts a 
set of responses in an additional pop-up box from which 
the nurse must select one. Odyssey therefore imposes an 
organisational structure on nurse questioning that is 
absent from GP-led triage. This structure is not only in 
terms of the number and order in which questions are 
asked, but also how questions are designed to elicit a 
response from patients that fits those offered by Odyssey. 

The sequence and screenshot in box 2 (figure 1) illus- 
trates an interrogative series common to the wider infor- 
mation gathering activity in nurse consultations, using 
polar questions which first constrain the type of 
response available to patients and second are designed 
to prefer 'no problem' type responses. In this sequence, 
the caller is a mother of an infant who has a high tem- 
perature. The nurse has activated the CDSS using the 
keyword 'high temperature', which has led to the CDSS 
prompting the nurse to ask the caller about vomiting. 
This first question is a fully formed interrogative, with 
the negative polarity item 'at all' preferring a no 
response, indicating the nurse presupposing an absence 
(and therefore 'no problem') rather than the presence 
of vomiting. The preferred response is therefore one 
that should not only be brief (yes/no) but one that also 



Box 2 Nurse-led triage: 'no problem' design questions 



N: And has she vomited at a:ll 
P: No (.) she hasn't no 
N: And >l know you ha-< you said you hadn't given her her a 
>bottle this morni-< but she is taki::ng (.) flui::ds 
P: Yes she's drinking some (water) 
N: And she's weeing okay 
P: Yeah she's weeing absolutely fine 
N: No ra::sh? 
P: No no ra:sh 

N: Otka::y, (1 .8) and no other symptoms she's not coughi::ng 
P: tShe had a little cough this morning (3.2) but not a constant 
cou:gh 

N: |And tnormally we:ll no other problems normally:: 
P: No she's normally fine running arou:nd like a, 
At 1 min, 45 s* 

*The times here refer to the time that the extract begins in relation 
to the start of recording. 



informs the nurse of the absence rather than presence 
of vomiting, which will enable a quick transition to the 
next topic. The mother offers the preferred response 
with a partial repeat of the nurse's question 'No, she 
hasn't'. The nurse is then able to move on to the next 
item in the list of prompted questions, 'but she is taking 
fluids'. This time the nurse's question is designed as a 
declarative with an optimised presupposition aimed at 
obtaining confirmation. The mother again responds 
with a short reiteration of the nurse's statement, func- 
tioning to confirm that the nurse's presupposition is 
correct 'Yes she's drinking some water'. The same ques- 
tion design is then repeated 'and she's weeing okay'. 



A 



Add symptom | Emergency 



Doclet 



Exclude (0) Screen Vtow 



High lempcraturt 



Onset 

Current Slate 
Appearance/Sin 
Temperature 
Ft-Descriptoon 
Breathrtg Problem 
Vomtjng. sever ty 
FeeoVFMdmtafce 
Urine (past 6 hrs) 
Rash 

Fontanele Prob 
PainSte 
Other Symptoms 
Recent brims 
Tropical areatasi 
PMHACrvonc Os 
fiV? d i Arrmuno supp 
Treatment Tried 
GP/HV Advce 




Breathing Diff 



Onset 

Current State 
Blue Complexion 
Instant Onset 
Inhaled/lngest 
Swelng 
Apnoec Episode 




►ing uw nor maty past 6hrs (or 
nappies)* 

iy<»ated 



P»*tf*esplretory Dts 
Pfct^r cuWionDrs □ 
Medsff*esp»atory 



Figure 1 Nurse-led triage: CDSS during 'no problem' 
question series. 
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Again the mother repeats the nurse's words and con- 
firms 'Yes she's weeing absolutely fine'. The nurse then 
switches to a negative declarative design presupposing 
an absence of a rash, and again we can see the mother 
follows the same pattern. However, following the nurse's 
next question, we see a slight variation in the mother's 
response. The nurse again presents a negative declara- 
tive question 'she's not coughing', but this time the 
patient appears to disconfirm the nurse's presuppos- 
ition. However, this is not a direct disconflrmation (eg, 
Yes she is coughing), but instead the mother qualifies her 
response — not a constant cough, functioning to uphold 
the nurse's presupposition as at least partially correct. 
Finally, the negative declarative 'no other problems nor- 
mally' is issued with the mother repeating the previous 
pattern, confirming the optimised presupposition that 
there are 'no other problems.' 

This example was typical of how nurses could be seen 
to manage the demands of the CDSS prompts by adapt- 
ing questions that enabled swift progression through the 
consultation. The use of And to preface questions, use of 
multiple declaratives, optimised for confirmation, and a 
process of ellipsis whereby questions were shortened 
made this information gathering activity appear more as 
a checklist designed to rule out serious difficulties rather 
than orienting to the patient's specific presenting 
problem. Consequently, contracted sequences of interac- 
tions with short turns, illustrated in box 2, were a 
common feature in the nurse-led data but virtually 
absent in the GP-led data. 

In a few cases, nurses could be seen to incorrectly 
presume a 'no problem' response from patients, result- 
ing in some interactional difficulty whereby patients had 
to disconfirm the presupposition embodied in the ques- 
tion. In box 3, an example is provided of a nurse asking 
about the radiation of pain, delivered as an optimised 
negative declarative statement for the patient to 
confirm. However, there is a pause and then a non- 
straightforward response from the patient 'We::ll...', 
which serves to neither confirm nor disconfirm the 
nurse's presupposition. Even after referring to a previous 
statement and restating that there is some pain in the 
buttocks, the patient softens the weight of her discon- 
flrmation with a further T don't know' The effect is that 
the 'no problem' design in this case leads to a lack of 



Box 3 Nurse-led triage: 
actional difficulty 



problem design causing inter- 



N: And you don't feel that it's moving down into the buttoc ks 
(0.6) 

P: 
N 



::w it= 



We::ll [I'd say it] (0.6) well I don't kno: 
[(?)] 

=(.) it's as I sa:y it ha- halfway do::wn the buttock an- 
so far in I would think I don't tknow 
N: Okay that's fi::ne 
At 1 min, 53 s 



(.) not 



clarity as to the location of the patient's presenting 
symptoms, which is likely to be reflected in how the 
nurse records the patient's response in Odyssey. 

GP-led triage: questions designed to elicit patient's 
explanations 

In contrast to the exhaustive CDSS-led questioning 
about the nature of the reported symptom and wider 
information gathering around it apparent within the 
nurse-triage data, GPs were frequently observed eliciting 
the patient's explanations for their symptoms. In the 
extract outlined in box 4, it is evident that early on in 
the triage consultation, and immediately following the 
patient's reported symptom, the GP attempts to rule out 
any obvious explanations from the patient. Following an 
initial marked confirmation, the patient takes this oppor- 
tunity to list the candidate explanations she has consid- 
ered and the GP then moves straight to triage 
resolution. Importantly, despite the GP using polar 
declarative questions that request confirmation, they are 
orientated to the ongoing talk and caller's responses 
rather than presented as a series of checklist-style 
questions. 

Interactions where the patient's explanations were 
oriented to and followed up by the GP were very rare in 
the nurse triage data and indicate GPs and nurses orien- 
tating to different aspects of the assessment process 
during triage. Box 4 provides an example of the poten- 
tial of orienting to the patient's explanations for deter- 
mining triage outcome more efficiently, without an 
exhaustive interrogative series delivered through the use 
of the CDSS. However, we observed many instances of 
GPs and patients engaging in lengthy discussions about 
the possible causes of symptoms as well as GPs obtaining 
a detailed wider history from the patient, both of which 



Box 4 General practitioner-led triage: eliciting patient 
explanations 



P: =on it woke up this morning and my who::le (.) my whole eye 
and the whole left hand side of my face is complete swollen, my 
teyes almost closed, 

D: °0kay° (.) and there's no obvious explanation for that y 
P: Not at all 
D: °No okay° 

P: No I haven't I haven't suffered it, (.) y- y::ou know >l don't 
suffer with< hay feve:r (.) haven't been anywhe::re (.) unusual or 
y- y- you kno::w didn't [walk the dogs in any (field)] 
D: [(?) ] (o:r) or got anything in the eye or 

anything like that 
P: No: (>got to admik) I went to be:d at half past ten (.) perfectly 
fi::ne (.) and m- 1 do sleep with my window slightly open 
D: °Yep° 

P: Urn a::nd (04.) went straight to sleep within an hour I just sat 
bolt upright (0.4) with >this like< tburning sensattion 
D: Okay (.) I think we're gonna need to take a look at you .hh can 
you [come] in this morning? 
At 0 min, 14 s 
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were less common in the nurse data. By contrast, nurses 
using CDSS did not engage in lengthy discussions about 
possible diagnoses even when one was offered by the 
patient, instead confining to the information gathering 
demands of the CDSS. 

Nurse-led triage without CDSS 

On a few occasions, the Odyssey software was not acti- 
vated during the recorded nurse-led calls. In these cases, 
question-response sequences were identified that did 
not follow the same pattern as those where CDSS was in 
use. Box 5 provides an example of a sequence where the 
nurse, not using CDSS, begins the wider information 
gathering activity with a typical opening question about 
duration followed by a declarative question designed to 
confirm previous patient information. However, instead 
of then asking a series of questions aimed at gathering 
information on related symptoms, the nurse proposes a 
candidate diagnosis. In a similar way to the GP data, this 
potential diagnosis is then negotiated with the patient 
within the ongoing interaction. 

DISCUSSION 

Despite nurses asking three times as many questions as 
GPs, the similarity in the duration of triage calls is 
explained by the content and form of questions used 
and their different interactional consequences. Most 
notably, nurses' frequent use of 'no-problem' polar 
declaratives requesting confirmation, deployed predom- 
inantly to gather information around the reported 
symptom, created contracted question-response 
sequences. These features were almost completely 
absent in the GP data where more polar interrogatives 
were employed to request information from patients, 
taking a more unknowing stance and allowing more 
room for elaboration or sequence expansion. 27 GP ques- 
tions also launched a wider range of activities including 
eliciting patients' own views and obtaining a relevant 
medical history. This differential distribution of question 
design, action and activities in the GP data led to typic- 
ally longer patient responses and subsequently to other 
kinds of practitioner contribution such as GP's own eva- 
luations, patient education or advice. The nurses, using 
CDSS, and GPs, self-determining their questions, could 
therefore be considered to promote different aspects of 



Box 5 Nurse offering diagnosis when not using computer 
decision support software 



N: an ongoing, (.) she's had a (.) recent viral illness 
P: Yeah 

N: And she's pulling at her (0.6) ea::r is tit? 
P: Yea::h, (.) both of them 
N: Is she [teething]? 
At 1 min, 3 s 



the clinical assessment process during telephone triage. 
While nurses' focus on current symptoms emphasised 
an assessment of urgency and efficient risk management 
of the patient, GP's attempts to elicit patient's own expla- 
nations and obtain a wider medical history demonstrated 
more familiar consultation behaviours. 28 

The interactional differences observed in our sample 
reveal that nurse-led telephone triage, using CDSS, is 
not a straightforward like-for-like substitution for GP-led 
triage. The design of nurse questions could be seen as 
an adaptive strategy to the constraints of the software. As 
a result, their attempts to rule out more serious condi- 
tions manifested as a series of linked checklist-style ques- 
tions that appeared closer to a social survey than a 
medical interaction orientated to patient's specific pro- 
blems. This is reflected in the findings of the ESTEEM 
process evaluation (JL Campbell, personal communica- 
tion, 2013), which found that some patients did not 
understand why nurses asked so many questions during 
triage calls, revealing that patients experience triage dif- 
ferently when conducted by a nurse using CDSS or a GP 
without CDSS. 

Our findings also demonstrate that GPs acting inde- 
pendently, and nurses using CDSS, are likely to obtain 
different types of information from patients. The differ- 
ences in information collected may have an impact on 
how GPs and nurses decide on management and dispos- 
ition, and also on how patients are assessed in any subse- 
quent consultation following the triage call. A key task 
for assessing the value of these different approaches 
therefore lies in research that examines how the content 
of triage calls is used in, or informs, subsequent 
face-to-face or other primary care consultations. 

GPs have historically been cast as expert decision 
makers, and so it is perhaps not surprising that their eli- 
citing of patient perspectives and detailed history have 
been identified as common features of both face-to-face 
and telephone consultations. 15 Patient-centred consult- 
ation styles have been shown to lead to increased patient 
satisfaction, treatment adherence and treatment out- 
comes, 29-33 and it would therefore seem to be a logical 
style to reproduce within triage calls. However, the 
primary aim of telephone triage is to manage and direct 
patients within the healthcare system. GPs, when elicit- 
ing patient explanations, may therefore contribute to 
longer triage times than might be necessary to deter- 
mine the triage outcome. Nurses using CDSS, by con- 
trast, would appear to strictly adhere to the end point of 
patient management and perhaps more efficiently deter- 
mine the route patients should take in primary care. 
However, using CDSS involves extensive questioning, 
which may also unnecessarily contribute to longer triage 
times. How these different triage methods affect triage 
outcome and overall consultation time; whether training 
nurses to adapt their question design when using CDSS 
affects triage outcome; and how patients experience and 
respond to these different approaches are key issues 
requiring investigation. 
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Limitations and strengths of the study 

This study was limited by the inclusion of only two GP 
practices. It is possible that nurses and GPs conducting 
triage in other GP surgeries would have employed differ- 
ent patterns of distribution of question designs, actions 
and activities to those reported here. Although GPs did 
not use CDSS to triage patients, we also recognise that 
GPs may have actively consulted electronic patient 
records while triaging, which might have provided an 
interesting comparison to the nurse data. 

Given further training and experience of the CDSS, 
nurses might have delivered different interactions from 
those we observed here. However, our findings clearly 
demonstrate how the CDSS imposes a structure on the 
number, order and design of nurse's questioning com- 
pared with GPs questioning. This is backed up by our 
observation of nurses' different questioning pattern 
when not using CDSS. Investigating how nurses with 
extensive training in the use of CDSS communicate with 
patients, and how this compares with nurses not using 
CDSS would therefore provide important insights into 
the contribution of CDSS in supporting nurses to deliver 
safe and effective patient management. The resonance 
between nurses' questioning in our data and interactions 
observed in National Health Service (NHS) Direct con- 
sultations 18 ; and the GP's questioning style in our data 
and previous research on telephone consultations 15 also 
indicates how our findings may be transferred to other 
primary care settings. Training for telephone triage 
could be designed to incorporate working with sample 
recordings and transcripts of real calls to illustrate the 
full range of questions that can be asked in the inter- 
rogative series; and how question design itself can be 
consequential for the nature of a patient's response. 
Studies such as the one reported here therefore offer 
important insights into the actual implementation of 
telephone triage using different professionals, and how 
CDSS can organise telephone triage interactions and 
patient experiences. Such insights can assist with the 
training of those professionals in conducting triage; with 
revealing how the design of CDSS systems might be 
more effectively configured; and with the management 
of patient expectations around new technologies for 
medical service delivery. 

Although the parent trial to this study examined the 
issue of patient safety alongside telephone triage, 23 we 
did not specifically examine safety in this qualitative 
study. Previous relevant reviews 2 34 and individual 
studies 4 6 17 35 are conflicting in respect of patient safety 
outcomes and the related matters of hospital admissions 
or A&E attendance associated with triage. Specific con- 
cerns have been raised in relation to the quality of infor- 
mation gathering in telephone triage consultations, 8 17 
and the differences in information gathering between 
nurses using CDSS, and GPs not using CDSS, in our 
findings place communication, information gathering 
and the role of CDSS at the heart of ongoing debates 
about patient safety. 



Conclusion 

Our data suggest that nurse triage using CDSS is not a 
straightforward substitution for GP triage without CDSS. 
CDSS, employing algorithms designed to minimise risk, 
plays a fundamental role in organising nurse's question- 
ing during triage leading to differences in the number, 
content and form of questions used by GPs and nurses. 
These differences have consequences for the type of 
information collected from patients during triage calls 
and for how patients experience those calls. These find- 
ings are based on a small sample, and it is not known 
how these triage styles are linked to triage outcomes. 
However, given the well-established relationship between 
consultation style and outcomes in primary care, our 
findings provide important evidence for the training of 
staff and for the design of CDSS in supporting staff to 
conduct telephone triage. 
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